I 



^ DOCUMENT EESDHE* * 

ED 127 304 , SP 010 341 

ADTHOE * Whitmorev Paul G. ;^ iind Others ' . ^ 

Tj-ji^v cjGain in Student Achievement as a Function of 

S • ' Inservice Teacher Training in Classrccm Management 

Techniques. Technical Eepout 7j2-26. ^ ^ 

INSIITOTION ' Human Eesoi»rces Research Organization, Alexandria, 

Va.' ^ ^ 

SPONS AGINCY Fiver Rouge "^Public Schools , Mich. 
HEPOP.T NO ^ • HufflRP0-TR-72~26 
PUB DATE * ^Oct 72 c , 

.NOTE 51p. 

5DES 'PRICE MF-$D,83 HC-$3. 50 Plus Postage, 

DEtSCEIPTORS *Achievement Gains; Behavioral Objectives;^ • 

*Contingency Management; Elementary Education; 
Inservice Programs; *Inservice Teacher Education; 
Learning Modules; Performance Based Teacher 
Education; Professional Training; Reinforcement; 
^ Student Teachej: Relationship; Summer Institutes; 
^Teacher Workshops; ^Teaching Methods 
ITENTIFIEHS Michigan*^ (River Rouge) 

ABSTRACT / \ ' * ^ ' 

During the summers of 1970 and 1971, the Human 
Resources Research Organization presented a special inservice ^ . 
training program to elementary, teachers^of the River Rouge, Michigan, 
School District. This report evaluates the. effects of this training 
program .and focuses on the determination of gains in student 
achievement that may be attributed to/the program. The training 

~""prcgTam ^-a s ^T i ei ^—x)-t-myTk^h^xips-^ ns i m iBeMraj:-e- fo 1 low - on 

effor-^-s — sf^ught to increase achievement in students by changing 
instructional practi<:6s used by teachers. The workshops focusad on 
the following educational practices: (1) development and use of ^ 
instrucrional objectives; (2) implementation.^of concepts of learning 
modu3,*^s and mastery tests; and (3) employment of contingency ^ 
management techniques in the classroom. For grades 2.-7, students of 
program teachers gained almost >wice as much on a standardized 
achievement test as did students of non-program teachers; differences 
in mean gain scores in reading and mathematics were both 'highly 
-significant. For grades K-l, students of program teachers tended to 

^ have higher gain scores than students taught by non-program teachers, 

^*but the differences were small. No single "factor appears .to account 
for the enhanced student gains produced by program teachers. Th^y 
Vere' apparently due to the integration of workshop training, trial 

. . implementation, classroom observation, availability of teacher aides, 
and frequent guidance and assistance provided to teachers i 
(Appendices include: teacher performance, objectives ; program 
coordinator performance objectives; inferred achievement test 

* objectives with sample test items; teacher questionnaire; 

administrator questionnaire; and agreement between project teachers 
and program coordinator.) (MM) ' , >i 



»-* ■ 

Documents acquired by EftIC include many informal unpubUshed materials not available from other sources. ERIC makes every 
effort to obtain the best copy available. Nevertheless, items of marginal reproducibiHty are often encountered -and this affects the 
quality of the microfiche and hardcogy^ reproductions ERIC makes available via the ERIC Document Reproduction Service (EDRS). 
-^-Q-^ is not responsible for the quality of the Qriginal document. Reproductions supplied by EDRS are the best that can be made from 



Technical 
Report 

. 72-26. 

HumRRO-TR'72-26 



HumRRO 



Gain in Student Achievement as a 
Function of Inservice Teacher Training in 

\ 

Classroom Management Techniques 



Paul G. Whitmore, Williart) H. Melching, and 
Edward W, Fraderickson , 



<Vif 



HUMAN RESOURCES RESEARCH ORGAN IZATIONv 

300 North Washington Street • Alexandria, Virgifiia 22314 



October 1972 



NtRlC 



Prepared for: > 

River Rouge Schodi District 
River Rouge, Michigan 



2 



US DEPAftTMENT OF HEALTH, 
EDUCATION A WELFARE 
NATlONALlNSTITUTEOF 
EDUCATION 

TH.S nOCUMtNT HAS Bfk^ " ^ " " 
DUCED EXAfTiY AS WECE^PD f ROM 
?HE PERSON OR OROAS-ZATION OR. G«N- 
lTrNG. .T POINTS OP v;EWOR.OP.NtONS 
?;;TEi DO^T NECESSAR-.V R^PRE;^ 
^ENTQPFlCtAL NATIONAL .NSTlTUTE.OF 
EDUCATION' POSITION OR POL'CY 



HumRRO 
Technical * p 

Report 

72-26 




Distribution 
of this document 
is unlimited 



Gain in Student Achievement as a 
Function of Inservice Teacher Training in 
Classroom Management Techniques 

PaufG: Whitmore, William H. Melching and ' - 
Edward W.- Frederickson , 



HumRRO Division IMo. 5 
Fort Bliss, Texas 

HUMAN RESOURCES RESEARCH ORGANIZATION 



October 1972 



Prepai-ed for 

River Rouge School District 
River Rouge, Michigan 



The Human Resources Research. Organization (HumRRO) is a nonprofit 
corporation established in 1969 to conduct research in the field of training and 
education. It is a (SSJntinuation of The <5eorge Washington University, Human 
Resources Research Office. HumRRO 's general purpose is* to improve human 
perforniance, particularly in organizational settings, through behavioral and social 
science research, development, and consultation. 



x — ' ; ~ 

The contents of this publication do not necessarily represent the 
official opinion or policy of the sponsor of the HumRRO research. 



Published 
October 1972 ' 
by 

HUMAN RESOURCES RESEARCH ORGANIZATION 
300 North Washington Street 
Alexandria, Virginia 22314 



2. 



BIBUOGRAPHIC DATA^ M. U ju rtN'o. 

SHEET i ^M^!^.^*:^- 1^:^---^^ 

;;\IN I.\ SIUIIM- AailBVLMLNT AS A FlJ>;aTI^>>f'-«F- INSERVICE 
I'tACHiiR TRAINING IN CLASSROOM NL\NAl5l:Mi:NT THCilNIQUHS 

'7rvuiior'.> Paul it! Vvlutmore, William H. Melching, and 
.Lviward \y. FreJerickson * 

9. P'-l-f ni iai: Ortj.mi/ation Naint* .unl Address ,. 

Hurnan Resources Research. Organi2at;^on (HumRRO) 
300 North Washington Street 
Alexanoiria, Virginia 22314 



3. "Hct'ipivntVs Ai t fssiou No. 



5. Report Odie 

October 1972 



6. 



8. Performing Organization Kept. No 

Technical^ Repo rt 72- 2fa 

10. Project, Task, Work Unit .No. 



U. Contrat-l, Grant No. 



12. 'n'^^u^i^rai;: Or4 air./ «»tio!i N.mit- and ^ Idr^ss 

kivei* Rou^e School District 
i^lv^r .J^nifif, Michigan 



13. Typt' of Ufport &J^criod 
(^ovfrt'd 



14. 



15. Nipi»lT'n;'-t.* J 



N.a- 



;ion No. 3, hi Paso, T«i?xas 



WU report evaluates the effects of special inservice training of a group of 
elementarv' teachers, llie training prograni-a series of workshops plus immediate 
foilow-on efforts^sought to increase achievement in students by changing instruc- 
tional practices used bv the teachers. For grades 2-7, students of program teachers 
riined almost twice as much on a standardized achievement test as did students ^ ^ 

^ ^on-vvogxim teachers j differences in mean gain scores in reading and mathematics 
were b-nh highlv significant. For grades K-1, students of program teachers tended 
t?) have higKer gain scores than students taught ty non-program teachers, but the 
di-'ferences were small. No single factor appears to account for the enhanced student 
pains nroduce'd bv program teachers. Hiese gains were apparently due to the integration 

* of workshop training, trial implementationr-ciasSroom observation, availability ot 
teacher aides, and frequont guidance and assistance provided to teachers. 
■ " ' - ^ ' <^ 



17. K-^-v % T*!.-, dti'l OtuMini'Tit Analvsis. 17o. Oesf-nptcirs " 

♦Achievement tests 
♦Education 
*In.^tructoj^-s 
* Learning " - 
*Reward psychologyj 
*Schoors ' 
.*Students- „ 
*Tran-fer of training 



17b. Id'-ntifitTs Op^^n-Ended TfM-nis' 

Classroorr. .jr^anagenent techniques 
(lain scores 

Inservice teacher training . 
rerforniance objectives 
Prctgrani evaluation 
Teacher performance objectives 

17c. COSA if Fu l i Orr.up e30S)/()5 10 



Behaviorcti obj..ectives 
Behavior inodif i cation - 
Contingency management 
Individualized instruction 
Instructional ob.jecti.ves 
Mastery tests 



18. Avail^biiity St:Uf-rti'>nt'. 



Distribution of this document is unlimited 



19. Security Class (This 
Hf'porOujMCLASSIFIED 



, Security ChLs.«5 (This 

UKCLASglFIED 



21. No. of Pages 

48 

22. Prico ~ 



USCOMM-OC 40329-P7 1 



FOREWORD 



This report evaluates -the results of a teacher inservice training program conducted 
by the Human li^sourpes Research Oi>gania§tion for the River Rouge, Michigan School 
District. The program W designed to bring about improvements 'in the achievement of 
students by changing thi instructional processes used by teachers in the classroom. 
^ The report is cojaceVnod with evaluating the prpgram at the end of its second j^ear of 
operation. The primary \emphasis of the evaluation is on the determination of gains in 
'student achievement tha!t may be attributed to changes in instructional processes intro- 
duced by program teachers. . % Y 

The training was conducted by HumRRO Divisiqn No. 5, El Paso, Texas, Dr. Albert 
L. Kubula, Director. Dr. William H. Melching was the principal investigator and Dr. Paul 
-tlr-Whitmore participated throughout in the conduct of the work. During the first j^ear of 
^the work, Dt. P:(lwarcr Wi Frederickson assisted in presenting workshops and in guiding 
follow -on efforts. . ' " 

Special assistance in scheduling and arranging the workshops and in guiding ^eachers 
during follow-on efforts wa.s provided by Mr. Fredric A. RiA^kin, Director of Federal 
Pr{)ject.s for the River Rouge School District. , " 

The. training program and. evaluation were conducted under contract with the River 
Roiige, Michigan School Dii^trict. ^ . 



I ^ * Meredith P. Crawford 

„ ^ \ \ ^ * President 

■ \ " • Human Resources R esearch Organization 

% . ■ ' ' 
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StJmMARY AND CONCLUSIONS 



^ w '. .. ■ . .. e 

PROBLEM . ^ • " 

Durins tht^ summers of 1970 and 1971, the, Human Resource^; Resetureh Organization 
presented a smes of workshops to elementary teac^^n's of the River Rouge, Michigan 
School . District The ^vorkshops and a^ociated folld^-on efforts sought to bring about 
.mcrt^ased student achievement by changing instructional practices used by the teachers. 

This report is concerned with evaluming the program at the* end of its second yeai' 
of operation. The focus of the evaluation is primarily on determining the amount of gain 
m sttident achievement that might be attributed to the program. 

* * • * 

METHOD 

Tlu^ workshops focused on the following educational practices; 

Development and l^se of instructional Objectives ^ 
Implementation of Coiicepts of Learning Modules and Mastery Tests 
Employment of Contingency Management Techniques in the Classroom 
^ Workshops on these topics were designed fo provide participants with first-hand 
practice, und experi(ince. During the school year foUowitrg each summer workshop, a 
follow-on program was conduct(*»d. its goal was to increase the probability of successful 
attempts by teachers to implement thi^ techniques and procedures they had learned. 
Support for the* teachers wa.s provided- i>y~personnel Trom the School District and by 
visits from a team ^.of HumRRO researchers. .Numerous inservice meetings with ^teachers 
•were held throughout the two school years. 

Although program tjeachers had d&veloped and used behavior^il objectives for then- 
classes, there was no assurance that standardized test objectives were included. However, 
since funding from the state for the ^program was contingent upon attainment of a 
.specified gain oh a standardized test, it was felt 'that test objectives' should be made 
available to teachers. Since such objectives wegr^ unavailable from the publisher, they were 
constructed by 'the authors by inference from items on one form of the test. Sample test 
items were then developed from the test objectives and provided to each program 
teai*h+^r. Teachers were informed how the test objectives w^re made and were encouraged 
to generate additional test items. ^ No effort was made to control the extent to which 
teachers used such materials in their .classes. For evaluation purposes, students with a test 
achievement one year or more helbw grade level were designated target students Such 
students were selected only from classes of program teachers. 



RESULTS ' 

GradQS 2 7 ^ , 

(1) Target students readily achieved the gain m-achievement required by the state, 
(■2) Oain's of target students were not obtained 'at ti\e expense of non-target students 

of program teachers,, for the mean gain of-iion^target students was Actually greater. 

However, the difference was small and not statistically significant. 

i;3) When .scores of target and non-target students of program teachers were com- 

.hined and their mean scort^s compared with students of .non-program teachers, the results 
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showed , thai the students of program teachers gained significantly more. In fact, students 
of program ttwhers gained almost twice as much as didv s^tudents of non-program 

teachers. v * 

(4) Pretest scores of students of program teachers were found to be equal to or 
slightly less 1( in 9 o.f 12 cases) than pretest scores of students non-program teachers, 
thereby discounting the possibility that the rkults could be attributed to pretest 
' differences. 



Grades K-1 

Mean iain scores of students of program teachers tendedSto be larger than those of 
nyn-pro^ram teachers^ but the differences were small and inconsistent. No statistical tests 
were perfj)i|med. 



CONCLUSjlONS 

Severtil program aspects may have been influential with respect to, -the achievement 
gams shoU-ed by students, but no one single factor would seem to be primai-ily respon- 
sible. Teqchers acquired not only new classroom techniqiie^ but also new ways c5f 
'conceivmi teacher-student interaction and responsibilities. The outwai'd e%ct of these 
new conceptions was aa improved level of teacher functioning. There \yas a , more 
concerted effort to bring students up in achievemeiit/and this was possible^^'qcau^eahe- 
classrbonl athiosphere was ntore conducive to learning; that is, more childten were 
assigned [learning tasks at which they could succeed and' for which they could receive 
recogniti|c)n and approval with a minimum ust^ of coercion or threat. 
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M BACKGROUND 



0 



In the |i5pring of 1£)?Q, the River Rouge, P/ichigaH School District contracted ^ith * 
the Human 1^ Resources Research Organization to he^lp plan and conduct a progiram to 
incrtiase the? achievement of children in its four elementary schools. The resulting/pr 
consisted" o| teacher workshops and follow^on efforts designed to bring, febout improve- 
mtmts in the achievement -of students by changing the instructional processes used by^ 
ti^achers in^ the classroom. ..• ' / 

'Fhls i^eport is concerned .with the evaluation of the program at the en^ of its second 
year of d^)eration. The primary emphasis the evaluation is on the determination of 
gains ill ^Ludent achievement attributable to the changes in instructional processes intro- 
duced byf the program teachers.' ' . /' . . 

"A (|omplete description of the activities of ' the set of workshops was prepared 
previously fl), but to aid the 'reader with the current report, a ^4n^ral review of^the 
rational(| and goals of the workshops will be presented here. / ' 

TEACHER WORKSHOPS ^ \ 

tIvo succekive groups of J:eachers were , trained by m^4ns of a series of inservice 
teache|: workshops conducted during the/summers of the /two years. of the program's 
opera^io 1^71970 apd 1971). During' the first year, 24 teacl/ers entered the program, and 
an^Wditional 25 were added during the second year. Tekchers were accepted into" the 
program on a involuntary basis only. However, they were p^id for their participation in the 
./■^^kumi/ier'w.prkstops md each one was assigned- a teachet aide* during -the regular school 
^>year/ Pro^r^im^.teachers^ were the only teachers in the River Rouge School District who 
'"'^•^had/te&chf!'-^* aides, ^ / 
* ' j fhe instructional^ processes that these workshops sought to establish in the classroom 
a^fe/basetf^ the prernise that poor academic performance. is largely caused-by ina^dequate 
-usfi of rewards or reinforcen?/ combined -with inadequately stated and inadeqUa^tely 
applied instructional goals and tpo low a learning ci^lterion. These deficiencies in instruc- 
tional processes Often result in high rates pf nnonpi^oductive or escape behaviors on the 
•purt o*£ the^children, vagueJy defined and perhaps/misdirected instructional activities, a 
' ^eLrtuhg efiyironment in- which failure and its /lebilitating effects are unnecessarily 
irfipos'ed upon many of the children, and an accuifnulation of habit interference between 
previously learned behavior and^new behaviors. / 

'the workshops focused on the following educational practices: : 
Developraent and use. of instructional objectives, 
a- Implementation of concepts of learning modules and mastery tests. 

Employment of contingency management techniques in the classroom. 
Work:.shops' on these topics were desigiied to pi/ovide participants with first-hand practice 
;and-experiTOce. Numerous practical exercises were built into each workshop, and partici- 
... ipante were asked to /Use instructional mater/als, course content, and specific -behavior 
. jproble^iYis /from their own work^environmeAts and experiences. The inteht of these 
jn^quirernents was th movT each'' teacher t/oward the operation of an iiidiyidualized 



classroom. 
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Tho motivutiDU and ronlrol Un^hniques to be acquired by the teachers irom the. 
several workshop experiences would, although seemingly .unrelated, actually constitute a 
set \>*f' closely interrelated procedures. The goal was to enable each teacher to implemenfe 
eac^b of the techniques-instructional objectives, learning modules, and contingency 
management- -in his class in the , coming school year. " ^ 



RATIONALE AND CONTENT OF THE WORKSHOPS , V 

A rationale f or eabh workshop is presented belqw. ' = , . 

Workshop on Instructional Objectives " : 

The need for instruction in this area is ,base'd upon' the premise that, although 
tca/'hers t-ustomarily attempt to' express the g(>als of their instructton, they often. do not 
^tatf thcM- goals in explicit and unammguous terms'. For exan^ple, they often.phrase such 
goals in tt'rms of the instructional content, or in ter^s- of ,the behavior engaged ii\by the^ 
teailier • Seldom are the goals of instruction . stated in terms of what the student must' 
learn to (Uk Todav the consensus among those' engaged in research on learning is that 
■better teaching pnd better learning result when goals are stated in terms of student ' 
performance. , ; , . * p • «p * . 

- l\se of clearly formulated statements of behavioral goals of instruction is desirable. 

<>ti st»verai tD'ounds. ' \ " ■ . , 

(1) Such statements communicate instructional content ^,and instructional 
outcomes more accurately and explicitly than do other means of stating- 
• class .goals. Thus, communication is facilitated between., teacher and 
•students, teacher and aides, or teacher and administrator. 
( 2 ; They foster preparation of relevant and necessary instructional experiences 
for students. When goals are 'clearly ^stated, it is easier t9 decide what 
iUfc^truction is relevant and what is irrelevant.* - ♦ « 

(3j They provide a sound ba.sis for the organization and .construction of te^ts: 
Without explicit objectives, meaningful and valid test items cannot be 
formulated. • > 

(4) They tend to ensure consistency in achievement from teacher to teacher or 
from* teacher to aide. ' . ' 

Workshop on Learning Modules and Mastery Tests 

Administrative requirements with regard to Qtgani^g and presenting inatwction are 
frequen^;lv not c^ompatiblO with the student's \eds, expectations, and capabiUties. 
"Because' teachers ar^^ "'con fronted \vith the need to "c^o^^^a stated amount of 'material m 
a gtvei/ period of time, there is often a tendency 'to present instructron faster or in 
greateW chunks than some students can effectively assimilate it. While the stud^ht is still 
struggling, to accomplish one segment of material, and before he has demonstrated 
maste/>' of it, new material may be introduced and he may never have an opportunity to 
ac^quii'e the missing knowle;cige'^ and skills. The result is that the student gets fa^er and 
farthir behind, and increasingly frustrated with "the system." " 

/An approach th this problem that has .enjoyed some success - is one in which the 
total amount of m^aterial to bi> learned in*a semester or in a year is divided into more 
murtag(^able segments called.. units "learning modules." Associated with each m&dul6 is 
an objective or 'set of .objectives, and a corresponding criterion or mastery test. The task 
for the. student m Earning the material is to undertake it module by module, adA^ancing 
to :i new rivodi V' only aftt^ he has satis.fac^toril./^acTomplished the* preceding one. 



This procedure tends toJoster more positive attitudes in the student towardHhe 
^ubjeet matter to be learned, partly because, he now has greater control over the rate at 
which materiid must be learfled. Some otiier benefits that accrue from the division of 
instructional cont?»nt into learning modules are as follows: - 
^ (1) They provide , a controllable instance in which desired student behavior- 
that is, learning -may be appropriately reinforced. Successful iiccomplish- 
\ ment of 'a^ module, in other Words, setsaip a situation in which the teacher 

• may rewai^d the' student. 
(2) The use of modules gives the student timely feedback about his progress in 
mastering the material to be learned. He knows how well and how fast he 
'is progressing, and he knows what is yet to be accomplished.- 
i^]) The ase of modules also tends toa'educe the number of opportunities in 
which the student might experience failure. The student is not permitted to 
attempt new instructional material 'until he has^ demonstrated satisfactory 
-performance in earlier material. . . • 

(4) Modules tend to reduce interference in leai'ning by beginning training on 
one behavior only after the preceding ones have been fairlWell established. 

Workshop on Contihgency Management (CM) . \ 

The way the teacher 'interacts with and responds to the studeht--whetHer or not the 
U^acher realizes" it-plays a significant role in the aftitude of the student toward learning 
and in his Ivvel of performance in the classroom. For example, the relative effectiveness 
of a classroom, the extent Jo /which studente engage in positive learning.activities, and the 
amount of disruptive behavior that occurs are all reflections of the extent of the teacher's 
classroom control. ^ - jvt 

^ Edwcationah literature amply supports the contention that the teacher can modily 
and conttol the performance of the students, both academic and disciplinary, by con-' 
trolling his own responses (2). This finding holds across all sorts of teacher personalities, 
and Tot all sortfr of studenLproblems. With , systematic training,^ any teacher can come to 
control his own behavior, in ways that will improve the performance of the children 

being taught. * ^ V ' . 

' ' The approach by which to institute such classroom^ co^ntrol-termed contingency 
management'^~ has> been found to be. an effective means tor facilitating appropriate^ 
human "^behavior. Its premise, derived fi-m operant conditioning r.esearch, is quite simple: 
The ' likelihood' of a given behavior depehds on its consequence. Behaviors that are 
""foUov^d 'by satisfying or r-war^ing events are more likely to recur than behaviors that 
are followed by' unsatisfact^ory or nonrewarding events. If the kinds of stimuli that are 
rewarding or reinfp-r'cing to- a student are 'known, by observation, then the reinforcer 
should be'preselted if the desired behavior by the student appears. For example, if candy 
IS knowK .) be a reinforcer for a student, thej:i it -ean be used to increase the likelihood 
-he w^ll perform a certain way; the candy becomes a tool by which to control (X;eiriforce) 

'specific student behavior. . ^ V* . . 

The nature of .stimuli that can be reinforcing Varies widely. Under certain cir- 
cumstances, any of the following may s^rve as reinforcers: mojiey, toys, food, free time, 
teacher attention, teacher praise, acadeW recognition, and , so - ^ 

It has become quite common to use simple tokens (e.g., "points") as remforcers. 
Because of tfte demonstrated effectfveness of tokens for maintaining and motivating 
academic behavior, many writers 's^ieak of a Vtoken economy.'' To help cOntrgr and 
motivate student performance^ the teacher and the student may enter ihto a cpntinggncy 
contract: The teacher informs the student that a. given reinforcer wiU'te awarded, when 
he displays appropriate behavior-c^orrectly pronounces a giveh word, constructs a 



senttmce, stays in his seat a fixed period of time, works an addition problem, or performs 
some other academic task. For such behavior the student may accumulate tokens or 
points, exchanging them at a later .time for a desired reward. ' 

A distinction was made between general CM procedures and 'formal CM programs. 
The general procedures consist of positively reinforcing (i.e., approval, praise, and success 
in learning) appropriate behaviors, extinguishing (i.e.. Ignoring) inappropriate behaviors, , 
and minimizing aversive conditions (including the use of punishment), in., the learning 
environment. A formal CM program consists of a" functional analysis of explicit behaviors 
in th'e learning environment and the specification and implementation of a behavioral 
strategy for modifying the frequency of such behaviors. Fpmial programs may ..vary frotti 
simple two-week programs for shaping one behavior of ope child to complex token 
economies extending throughout the year and concerned with many different behaviors " 
of a!^ the children in an entire class. 



CONDUCT OF THE WORKSHOPS 

* • . , " 

Each workshop participant received a 'copy of a special workbook prepared by 
HumRRO. This workbook sta'ted the objectives for each workshop, presented a schedule 
Vf activities, and- gave definitions of workshop terms. It also contained four sample 
programs in contingency management, providing detailed instructions to the teachers. 
Using the^ programs as guides, eat;h teacher could prepare procedures for modifying 
de.signated student behavior. 

Tfe workshoj)S extended over a period of four weeks in the summer of 1970 and 
four weeks in the summer of ^1^71. A total of 24 teachers attended the first workshop 
. and 25 attended the second. The contingency ma^nagement workshop was scheduled in 
' conjunction with instruction of selected students fi^om the River Rouge School District. 
The teachers were arranged in pairs and each pair was assigned to a class of approxi- 
mately 10 to is students. Each teacher pair provided its class with two hours of 
instruction in reading and mathematics, each day. Members of the researc^i, team visited 
each classroom daily tind provided each t^Acher with feedback regarding his application of 
contingency management techniques in the classroom.. 

A substantial portion of th^e instructional objectives Woirkshops was spent in de^;iving 
or selecting* and modifying objectives for use .during the regtilar sehooj year. A set of 
^-.terminal objectives was developed during :the first summer' for K-3. This set was refined 
and expanded* to . K-7 during tlie second summer. ' 

The objectives developed during the summer workshops provided the River Rouge 
School District with an tntegrated set of learning criteria. Ideally, these criteria shdUld 
have provided the basis for evaluating the effects of the program on student achievement. 
HoY^ever, other considerations led to the selection of commercial standardized tests for 
assessing' student achievement. Nof all the performances required on the test were 
included in the set of objectives developed in the summer workshops. Hence,^ it became 
necessary to augmefit this set of objectives with objectives that did specify the perform- 
ances required by the, standardized lests. Only in this way could instruction and evalua- 
tion be directed positively toward, at least some of the same objectives. The augmentation 
of these objectives is discussed laterjn this report. . 

THE FOLLOW-ON PROGRAM ' " 

' Daring the school year following each summer workshop, a followkjn program was 
conducted in which the -primary goal w.^s to increase the probability of successful 
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attempts bv teaoht-rs to impU>ment the techniques and procedures they had learned in. the 
summer Workshops' in -their regular classes. One premise of the follow-on program was 
that making a verbal or written commitment to p-erform specific activities would increase 
the probabilitv that a person would indeed perform such activities'. An attempt was madp 
Uy LVt each teacher to make a formal commitment to implement the use of behayioval 
objectives and contingency ..management in his , instructional procedures; making such a 
commitment would assure the teacher of administrative support for change activities. 
' The overall approach to the follow-on program involved group and individual 
meetings with teachers with periodic observation of teacher classroom behavior. Support 
for the teachers was provided by the school district administration and by a team ot 
HumRRO observers. The Director of State and Federal Projects in the River Rouge. 
School District was appointed the Program Coordinator for the follow-on program. It was 
his responsibility to conduct the meetings with teachers and to observe the teachers 
periodic:illy in the classroom and provide detailed and immediate feedback on their 
L-rformance He was to be constantly available to the teachers to help solve any problem 
that might arise. During the second year, he was joined in some of these activities by the 
BLstrict's Curriculum Coordinator. , c- 

To help U>achers and" the program Coordinator, a set of teacher performance 
obiectiv*.s wa.s prepared and distributed during-£he second fcillow-on program. 4 copy of 
■ these dblectives *.s given in Appendix A. In a parallel fashion, a set of pro-am coordinator 
• perfonnance objectives vvas also generated. A copy of these objectives is cwen in 

.\ppt ndix phase of the follow -on program involved observation of the classroom 

behavior of students b^' teachers .for the first five to six weeks of each school year. 
During this period, teachers were initially to identify behavior problems tliat disrupted or 
prevented the establishment of a desirable leai-ning environment. However, some teachers 
immediatelv began using- contingency manaRoment procedures with their classes.- A few 
teachers began the year 'by using the list of objectives generated during ^le . summer 
workshop to identify the performance levels. of the students coming into their classes. 
Thus, implementation of the procedures learned during the summer, workshops actually 
began before anticipated in these few ca.5es. - ' , u i 

' The Pro'Tam Coordinator held several meetings With the teachers during, each school 
year The HumRRO team made five trips to River Rouge the first year and three the 
following year and'^ w-ert present for many of these meetings. During these meetings, 
problem, encounte^red by teachers in implementing contingency management techniques 
and in using behayioral objectives in the classroom were discussed. Solutions ^ere- arrived 
at either through group discussion or through suggestions from. HumRRO research 
personnel. Contingency management programs were also developed and designed for 
individual teachers who had specific behavior problems in their classrooms These rather 
informal meetings were also used for providing feedback to the teachers regardmg 
U-chnical errors made in implementing CM procedures and: techniques, and for providing 
positive reinforcement of appropriate teacher behavior. . ^ 

Throughout eachVyear, the Program Coordinator gathered information and prepared 
reports of the activities., of program teachers. He selected exemplary programs developed 
-and applied by some of tl^ teachers in their" classrooms for publication in a special 
newspaper The Bugle, concerned only with activities in the program. In this way, he was 
ablr to n>inforee- successful teachers with - public - recognition and designate model 
program^i that other teachers might emulate. . - ' , 
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IVIETHOD 



ACHIEVEMENT EVALUATItDN 



The procedur(»s for t»valuating the effects of the program on student achievement 
were largely cleteriTuned by the requirement^^ ol> the funding agency during the second 
year of the program. Funds for the second year were obtiiined by the District under 
Section 3 of the Michigan School Aid Act. Such fund allocations are adniinistered by the 
Michigan Dep^irt men t of Education. \ ^ 

Programs funded under Section 0 of the Michigan School Aid Act had to be 
targeted tow^ird student>s who were (Mie or more years below grade level in either reading 
or mathematics.' Furthermore, it was specified that the level of funding available for the 
next yeiir would depend upon the achievement- gains attained by these targeted students 
diira>g the current yea;-. In order to receive full funding for the following year, target 
student.^" tire required to gain .75 gi'ade level in the preceding ten-month school year as 
(If tfrnuned' by pretesting and posttesting with an approved standardizi?d achievement test. 
If fht^ \)cnod between the pretest and pdstteh't^is not, a full ten months, then the 
itiimniuni acci»ptable gain, can be prorated from the ten-month requirement. 

Targt^t studt^nts were* selected only from the classes of program teachers, since the 
fuuds were used to. support actmties in which only they pai'ticipated. The results o/'the 
pretest were no't available to the p^^ogram teachers at the time when they had to select 
their target students. Hence, tht^y had to nAf on the results of tests given in previous 
years and on their own judgment." The luimber of target students in each program 
teai-her's class varied from four tc) 1 I, with an average of alnjost 11 per class. As will be 
disrusst^d later, there were 31 program teachers at this time. \ 

Although the testing effort was undertaken to determine the achievement gains of 
the target students! it was extended to include all students. In ithis way, it was^possible to.., 
compare 4he gams of target students with the gains'bf other ^students in the District as a 
means of determining the relative effectiveness of ^the programrteachers. 

The Michigan Department of Education designated a number of comrnercially 
av<ulable standardized achievement tests from whic^h each district might choose. The River 
Rouge Schoc)l District chose tht^ Stanford Early School Achievement Test, L^vel I, for 
measuring the gain of kiiidergarten and first grade students and the California Achieve- 
nient Test (1970 Edition), Forms A and B, for measuring the^gains of second through 
st^enth grade students. ' ^ ^' 

The pretest,s wtw actministered in October 1971 and the^^osttests were administered 
in May 1972, Tht^ intervening period was seven months, yielding a proratt^^l/minimum 
gain requirement for target students of .525 years" " • - 

AUGMENTATION OF THE INSTRUCTIONAL OBJECp^ 
WITH TEST OBJECTIVES , '^"^ 

' Although ^ the program teachers had developed behavioral objectives for their own 
rlasses during and following each summer workshop, there wjas no assuranoj? of complete* 



^Stu(ii»iUs ot* seventh ^rad<» toupj^ers who participated wore funded under a different projjram. 
'*^An inspection of pretvst score.s shows that teachers were r('markably accurate in selecting? as tarj^et 
students ^hose who scored in. the lower half of the class. 



overlap bouvoon Ih. U-ac-her-mado objectives tind the objeetives reilected in ttie 
standidized tests. Standardized tests must necessarily measure achievement m meeting a 
S cross section of ' instructional objectives from curricula throughout the nation 
Hen.-e the i)bjeetives might be more or less encompassing than those in any locally 
.uvepted currieuium. However, sinc-e the tests constituU>.d the c-rjterion of success, it was 
Telt that the te.st objectives should be available to the teachers. An attenipt was made to 
secure such objectives from Mc-Graw-HiU, publisher of the California Achievement Test, 
(CAT)'; They replied that the CAT was based on curricular content sampling rather than 

on behavioral objectives. _ . . c ^- ^ 

Smcv behavioral objectives were not available for the CAT, objectives for reading^ 
were constructed by the authors by inferring them from the items on one forni oi the 
test No objectives were constructed fc>r mathematics. It was found that the objectives 
infem-d frpm one form of the test specified the items on both forms equally well 
Sample items like those on the forms of the test wer» also developed for each of thi 
inferred behavioral objectives in reading. tu„ 
\ three-hour group session was held for .the program teachers. At this meeting, the 
research team went over the development of the test objectives and sample test items in 
reading It was explained that these objectives were developed specifically' -to ^avoitl 
-teu-hm" the test " The test objectives provided a generic substitute for the test itselt. 
The group discus.sed ways m which these materiaL< could be used, including: 

(1) As a means of specifying achievement deficiencies iri individual students as 
determined from the pretest. . , ,. 

(2) As a meafis of evaluating individual student progress toward eradicating 
achievement deficiencies. : 

' \s a b^sis for .selecting or developing practice materials for students. 

( U As a means of familiarizing students with test-taking procedures. 
The* program teachers were also urged to make up additional sample test items from the 
•objectives and exchange them among, themselves. In this wa^, no one, teacher would be 
burdened with too great a load in making up sample items. The teacjers were also 
encouraged to make up mathematics items ^n tlie ^sa^me format as used in the CAK 
However since the CAT was not available to them'i^nd nouTiathematics objectives had 
been prepiu-ed for it, the> .'ould not mak*y up items that directly "paralleled the content 

"^^Thrextont to which- program teachers, actually used these materials was neither 
■ .-ontrolled nor even determined. Informal reports to the Program ^Coordmator. indicate 
that at least some of the teachers used them in at least one of the ways. discussed at the 
. 'meetuig. ■ 

* ■ ^ • .■ , * 

•-QUESTIONNAIRES 

(XiesUonnaires we^re administere>d to the program teachers and their principals^at the 
end of the school year regarding their use of ^he classroom, practices stressed by the 
•''program and their- rec-ommendations for continuing aspects of the program. 



KSunpi.' I'^st ,)bj.-ct.vt-s dfvolopcKl irr thTS-^rt are prpscnted in Appendix C. Also included foi 
c-om^ar.s..n purpow's.aro some teacher-made instructional' objectives and associated test .terns. . 



> • RESULTS • 

ft • ■ 

Since several of the program teachers were dissociated from the prografn effort prior 
to the end of the study, it is necessary to account for each teacher before presenting the 
Results; whether qiiantitative or other. . ; * 

Of the 24 teachers who attende'd the 1970 series of works^iops, fdur asked to be 
dropped from the progi'am after one year, three left after one year because of pregnancy, 
one left after a- .yeiu: and a half because of illness, and one was transferred irom one 
school 4n the Rivet Rouge District to another school. Thus, these teachers are not 
represented in any of the quantitative results to be presented^ 'In addition, one other 
teacher, although she remainexJ in the program, is not represented in the quantitative 
results because she taught remedial reading. Thus, this evaluation contains 14 teachers. 

Of the 25 teachers in the 1971 program, three taught remedial reading ot special 
education, three taught " high- school classes, and two asked to be ^dropped from the 
program after the summer workshop. Data from these teachers are also not included in 
the quantitative results. Ira sujnmary, then, there were, 3J- teachers for whom student 
achievi^ment data were available— 14 from'the 1970 workshop and 17 from 1971. Of 
these teachers, 23 taught grades 2-7 while 8 taught graces K-1. 



STUDENT ACHIEVEMENT 



\ 



Gracfes 2-7 

In examining ^.the effects of the inservice training, the primary area Of interest was 
student achievement. Of particular interest, of course, was* the amount of achievement 
gain displayed by targi>t students. The., achievement test results for target students are 
given in Table 1. Because the number pf students who.f.took the pretest and posttest 
viu-ied slightly for reading'and mathematics, the number for each content area is given. 

Table 1 shows that tthe average gain in Grade Equivalent score for all target students 
was 1.02 for ..reading and 1.08 for matheniatics. The target students, therefore, readily 
exceeded t4ie gains sought by the District' . , 

\ Table 1 ^ • ' 

Mean Gain in . 
Grade Equivalent (G.E.) Scotes for Target Students - 





Number of 
Teachers 


Reading 


Mathematics 


Grade 


Number of 
Students 


Mean Gain , 
in G.E. 


Number of 
Students 


"Mean Gain 
in G.E. 



2 
3 
4 
5 
6 
7 

Total or , 
Mean 



5 
6 
3 
3 
5 
2 

24a 



59 
' 76 
^'33 
"^28 
45 
21 

2'62 



.99 
l.H 

."87 
1.19 

.74 
1.13 

1.02 



61 

75 

33 

28 

45 ' 

20 

262 



.74 
1.46 

.98 
1.21 
1.07 
• -74 

1.08 



^ ^Onfe teacher taught a fifth and a sixth grade d ass and is thus represented 
twrce m the data. A ' 

• ^ 1 O 
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To dotermint' whether gain.^ df target students were obtained at the expense of 
non-target students; a 'comparison was made between the average gains for these two 
OToups The foUowing procedure was used. First, it 'was assumed that the average -gaii^ 
^•ihown by all target students in a class could be viewed as a teacher score. Furthermore, 
smco each program teacher had both tai-get and non-target students, -a teacher score was 
possible for both groups of' students. Thus, two distributions of teacher scores were 
possible one for target students and one fbr noivtarget students. To compare the means 
of these two distributions, a t test was calculated. The results of ihis test are shown in 
Table 2. - , 

Table 2 . ^ 

• • domparison of Performance of Target and Non-Target 
Students of Program Teachers in 
Terms of Mean Gdin Scores 







Reading 


. Mathematics 


Group 


N * 


Mean 


s 

SD 


Mean 


SD 






Gam Score 




Gain Score 


Target 


• 24 


. — • 


.361 


1.08 


.445 


Nort-Target^ 


24 


1.21 


.364 


- 1.32 


.552 






t = 


1,23 




1.09 ' 



^.Values here are based on a total of 289 non-target students. 



With 46 degi-ees of freedom, neither of these t values was significant. In other 
words although there was a tendency for non-target students to sho\y a greater mean 
gain this gain was not statistically "significant. Among other things, this means that, in 
instances wher'e it would t^^ useful, one may combine, scores of target and non-target 
students of program teachers: ' , . ^\ 

'To determine whether the gains of program teachers (target and- non-target students, 
combined) were greater than those which might have been . expected had teachers not 
receive^d special inservice training, a'comparison was made with gain§ shown by students 
in classes taught by non-progi-am teachers-. In selecting classes of nc^n-program teachers 
certain limitations seemed justifiable. For example, classes of teachers who participated 
initially in the program but who later dropped out were not.included. Also, classes in 
>which the teacher changed during the school year (i.e., a new teacher );ook over Ihe class) 
Were excluded Finally, classes in which the student body did not remain relatively 
„constant %yere also excluded. Using these criteria, some 34 classes (grades 2-7) werq fouhd 
suitable for comparison purposes. . * ' 

To obtain meaningful measures of gain -for- non-program classes (or non-progi-^in 
teachers) it was first necessary to delete scores of all students who di^l. not take both 
pretest md postteqt. Once this.was done, protest and posttest means_.were calcuFated for 
*each dass.'Then, substracting the mean pretest score from the mean 'post-test score, a 
distribution- of mean gain scores was produced. The mean of this distribution W^s 
compared with the mean of classes, of all program teachers. A description of non-progr|jm 
classes in terms of numbers ot^dents and teachers is $hown in Table 3. , . { '"^ 

To compare the mean- gain in achievement of program teachers with non-progi-p. 
teachers a simple { test was employed. The scores of the 24 program teachers were ba^ed 



TablQ 3 



Description of Ctasses of 
Noh-Program Teachers 



Grade 



Number of 
Teachers 



Number of Students 
"^/Vith Pretest and 
--Posttest Scores 



2 


6 


125 




,0 


3 


1 4 


96 






4 


i .■ • 7 ■ 


161 


t 




5 ^ 


7 


165 






6 


8 


. J 74 






7 


",-2 


60 - 






Total 


34 


781 







pn the performance of 55^ studenU (262 target, 289-iTOT-taxg^ Jrire resutts of this test 
for both reading'and mathematics ai^ sho^n in Table 4. ! • 



Table 4 



Comparison df Performance of Program and 
jNon-Program Teacjhers in Terms of Mean Gain Scores 



\ ■ 1 




1 Reading 


'Mathematics 


C^roup 1 

' 1., " 1^" 


IM 


[Mean .\ - 
Gam Scbt'e 


sb 


Mean 
Gain Score 


^" SO , 


|,Progrlm 


24 


1.11 


.325 


1.20 


.449 


1 Non4''09''9rn 


, 34 




.461., 


. .63 


.435 


i 




\. 1^.09 


t = 4.83 


,1 ■ ■ 






M p<.oof 



\hm la'ble ihows that was highly significant, that is, that/the mean gain score 

of prograJTieaACTs was much- grWr, than that of non-progtSm teachers in both reading 
and matLlnlaticiS. Or, more correctly, the sWdents of program teachefs made significantly 
sreater kains iiiichigvement than did students of non^program teacher's. , . 

SinW gain |coreTare sometimes viewed with suspicion (3, 4), especially when pretest 
levels of kroupiS differ widely, the mean pretest scores for each grade level .for program, 
and nontpWam classes were calculated. Table 5 shows the results of these calculations.^ 
Ejc&inaticin /of this table ishows that, in the 12 comparisons reported, program 
classes bad' highW pretest means jn only three instances: These were in grade five (reading 
hnd mathemati^) and in grade six (mathematics). In all other 'instances, program.classes ' 
had slightly lowbr pretest means,- Because the differences were so small, no statistical tests 
■v^ere pei?formedj.. •. ' ; • " ■ : ■ 



Table 5 



Mean Pretest Scores of 
Program and Non-Program Classes 



Grade 


Reading 


r 

Mathematics' 












Program 


Non-Program 


Program 


Non-Program 


2 


1.84 


2.01 


2.02 


2.17 . 


3 


2.39 


2.69 


2!71 


2.73 


4 . 


3.80 


3.92 


,3.88 


3.95 


5 


4.91 


4.53 


4.58 


4.23 


6 


5.05 


5.10 


5.25 


. 5,23 


7 


6.39 


6.57 


5.95 


6.37- 



Grades K-1 

As noted earlier, all kindergarten and first grada^ students were administered the 
Stanford Eajly Schopl Achievement Test. Results , from this test are reported in raw 
scores rather than in grade equivalent scores. -Table 6 shows the mean raw gain scores for 
target and ncm-target students of all program teachers. Scores for the two subgroups were 
combined at the start. - 

Table 6 9 

Mean Gain in Raw Scores for K-1'Target and ' ^ ^ 

Noa-Tar§et Students of Program Teachers . ^ 





Number of 
Teachers 


Reading^ 


Mathematics 


prade 


Number of 
Students 


Mean Gain 


Number of 
' Students 


Mean Gain 


k " : 


'j" . - 

T- . 


41 • 


8.5 


41 


5.8 ' 


> 

Pre-Prtmdry 


1. 


10 ' 


10.7 


10 


9.6 


1 


6* 


128 


' 5.1 ^ 


128 


4.2 



' To evaluate these; gains, an attempt was made to find comparable classes taught by 
non-program teachers. U%Lng ;^]^?^ame criteria of selection as'%ith Grades 2-7, only a few 
classes could be identified:' The data-frpm these classes are presented in Table 7. 

' ' - • - ; * Tabl(&7^ ^ ; 

" ■ ■ i- ■ ' ■ ■ " ' ■ ' 

Mean Gain in Raw Scores for K-1 Students Taught by , 

Non-Program Teiachers ; 



X- 





Number of 
Teachers 


Reading ' ■ ^ 


Mathematics 


Grade 


Nnmber of 
Students , 


Mean Gain 


Number of 
Students 


Mean Gain 



Pre - Trim af^L 

1 ''^x. 



67 

-9" 



8.2 



75- 



3.9 



67 
75 



6.8 
2.9 



13 



A comparison of the two labk'« showsJJiaJJht&tudente..ol£m teachers gained 
shghtfy .m"5Fe" than stude^tTSf non^^^^^^^^^ teachers in all but one instance (ipathematics 
at kindergarten level). Because the differences tended to be smalt and because so Jew 
non-program classes could be found, no statistical tests were made of the differences. 



TEACHER REACTIONS '• • 

To obtain some feedback from program teache,rs regarding their use of instructional 
obiectiw;- Efforts at individualizing instruction, preferred reinforcement managenient 
technique, and so forth, a special questionn^e was devised and administered m May^ 
1972 A total of 35 teachers completed the questionnaire. . ^ 

For convenience the questionnaire is used to report the teachers; responses to tlje 
items in Appendix D. The questionnaire shows tallies ' indicating how the. teachers 
ansvvi'fs wi-ri' disiributed on the' various, questions. - 

■ In- general responses of teachers indicated that, while they were far frbm unammous 
with respect to the use of particulai- objectives, the majority of teachers .(65% or more) 
used Objectives rather ext(>nsively either , as guides to preparing lesson plans or as aids in . 

35 teachers "indicated they had attempted to individualize 
instruction Nearly all (857. ) these teach used commercially available teaching materials 
as weir as their own materials in their individualization efforts. Most teachers seated 
ri-ading and arithmetic a.s the content .areas in which to attempt individualiza ion. 
Approximately 15% bt the teachers felt that they were at least ''fairly successful inj^heir- 

■''"°'with respect to u.se of- positive^ relnforcemeni).,,^practices,' some^ 80% of the teachers , 
acknowledged that-their use of such practices had- inc^reased at least a mbaerate amQunt. 
What teachers viewed as most effective disciplinary -practices, h^owever varied widely, 

J any subscribed to a point or^ token reward system. Others preferred.^verbal pra,se 
ignoring students, giving special rewards, applying group pressures, P/°^'ding acaUem c 
success ensuring a threat-free class, using a- reinforcement jnenU, and so forth. At the 
sam(- 'time some felt that withholding rewards-or using.some form of punishment, was 
most etective. In summary, then, the full r^^nge of positive and-' negative remfprcement 
techniaues- appeared to have been used. ■ r.;- 

^ \Vith respect ^o-possibl? changes in th deprogram, 40%. either felt no change wis 
■nece=;sary or had no comment to make.- Other teachers suggested the merit of obtaining 
more teaching materials for the instructor, providing each teacher with more help , and 
Sper^-ision, Educing the an.ount of formal paper- work, ;and ax-ranging mpre^ frequent 

'^''''^^y'^^, of teachers offered any "gripes" about the program Most 
were complimentary toward the program coordinator and toward the prPgram itself. One 
or two teachers wanted more classroom observations by the coordinator, less paper: work, 
and more help in individualizing instruction.. ■ 



ADM HSnSTHATOR REACTIONS • - • \ 

To obtain reactions of school administrators ,tu the program a brief questjonnaire 
was constructed (Appendix E). The questionnaire was administered to the four: 
elementary school principals, the administrators most directly concerned with the possible 
Tmpact of the rro£amV Responses of principals to .the questionnaire are provided on the 



questionnaire in Af^pendix E, , 



By their responses, the prihcipals indicated a general awareness and approval of what _ 
the teachers were doing, viewed teacher and community attitudes towaid the program ©s. 
•favorable, and recommended that the help provided to schools in their efforts to improve • 
instructioh .be continued. In^ light of these reaction's, it is somewhat startlmg to note that 
no -principal recommended that funds for reinforcers be continued. (See last iten on . 
question VI.) ' ' ■ 

' ■ * , ■ . *• • 

• ' DISCUSSION . / 

■ , At the time the inservice graining program was- initiated, there was. no expectation 
that rigorous evaluations and comparisons with^.JJQCu-ptogram teachers woujd mvDiyed. . , 
-The matter of priipe interest was the effect of. special training activities on the classroom 
behavior of program teachers. This included, of „ course, the academic performance of 
.students but at this time there was no attempt made, to match teachers; students, classes, 

or schobls Such an approach would have entailed'^a rafher complicated and costly design, 
.whicti -••would not be justified as being in consonance with the District's pragmatift goals. 
The object was to effect change with proven processes rather than conduct research. 

■Later when it Was; known tl>at the amount of futufe funding to school districts 
would, be directly tied to achievement of students, a special- interest in student achieve- 
ment ensued. It was at ..this time, then, that preliminary thoughts were -given to pro- 
cedures by Which performance of program teachers might be compared with non-program 
. teachers. It should, be clear, in other words, that the study reported h«re was never . . 
, viewed as an experiment in which program teachers served as experimental subjects and. 
non-program teachers served as control subjects. ' " ^ ^" 

The paragraphs abov.e are intended to provide some justification for the comparison 
procedures that Were 4ised. It is acknowledged that they may not have been optimal 
Program teachers, for example, were all volunteers; teachers were not randomly assigned 
to program or ' non-program groups. One might question, then, whether program 
teachers-being, all volunteers-might not simply have been better teacher? at the start. - 
Furthermore: systematic observatiot^ were not made of non-program teach&s nor were 

- they prbvid^d with lall' the supplementary resources given, program teachers. Deipite these 
'and other matters, however,-a concerted effort was m^de to identify unbiased non- • 
program classes -(teachers) so -that meaningful comparisons in achievement could be made 
with program classes (teachers). With regard to achievement„the results were clear ,r 

■ . Without ^question, the most striking .finding reported in the results was.the saarp 

- sain in achievement (grades 2-7) sTiown by students of program teachers compared with . 
students of non-program teachers. The finding would seem "to leave httle doubt about the 
effects of the training and assistance ' that were ptovided to program ^teachers. As was 

- shown in Table 4, the mean achievement gain' for program classes was twice that ot 

= non-program classes for reading, and alrriost that much for mathematics. Even with all the - 
limitations -and shortcomings sometimes leveled against gain scores, this, difference h^ 
■ ^ obvious practical significance. The fact that pretest means "of program classes were, in 9 
of 12 instances, s maller- than npn-program' classes,;jlends even more weight to . the 
conclusion that tEe'gains were real. =. = ^ s • i a w^f 

Why simile differences in achievement gair^s were not found in K-1 grades is. not ^ 
known Perhaps achievement tests at these levels ^are not sufficiently sensitive to ' 

■ instrud-tion-. or perhaps test scores at these levels are not as reliable as might be desired, 

■ '» the Program Ooordinator's personal opmign was that the program teachers as a group were repre- 
sentative of the teachers in the system. ■ . ^ 



or pe'rhap^^ no treatment effects. This mi^t be an area for special 

inquiry in future efforts of this type. . ' ^ * 

In seeking to identify specific aspects of-^the training program that may have been 
most influential in producing the grades 2-7 rfesults, one can only offer certain specuia- 
tions* As might be surmised, no effort 'was made at the start of the study to provide 
meanis by which the effects of program aspects could be statistically isolated. There 
appeared to be no need for such sophistication as* it was an action program., not an 
experimental research effort.^ ; ' 

fhe following several ^'groups of factors need 'to b'e examined in any attempt to 
identify the source of the achievement gains. , * 
- : instructional ^processes . f 

■ :■: (1) fiehaviord objectives * . ^ . 

^ : " Teacher HeA^elopment 'and ' application of grade i§vel instructional 
1 o6jeei4yes. ' - ' ^ 

" , . ; ; Teacher d^l-Qpment and ap^ipation of achievement test objectives and. 

! , sample items?^- , , * i " 

i (2) Contingency management \ 

Teacher appilication of general contingency management procedures. 
TeaGher application of formal contingency management programs. 
(3) Mastery learning . ■ , 

T eacher aides . * 

^ motivational and guidmice resources provided to the teachers . 



(1); Group meetings , * \ V 

^ (2) Coordinator visitations,, feedback, guidance, arid-app 

a?he questionnaire'-- responses- tabulated in Appendix D indicate that the gre^at 
majority of the program teachers used instructional objectives both to guide their 
preparation of- lesson plans and to check-off pupil progress. Although there are no 
questions directly concerned with mastery learning, checking* off pupil progress against 
objectives is certainly an approach toward ^mastery requirements. In learning how to 
select "and write objectives, perhaps the most important result was that teachers came -to 
use more useful' practices-^t least from the student's. viewpoint. In other words, regard- 
less of , the origin of pbjectives (workshop, textbook, teacher, or test), the fact that 
^objectives tended to -be used more often than ih the past^ suggests that, the focus of 
teachers came to be more on the behavioral demonstration of .achievement by individual 
students than on 'the presentation of instructional content. The program teachers may 
have become more ^interested in what students can do now and what they should be able 
to %o in the future than in hm many paragraphs, chapters, or books^had been 

completed, * • 

• A somewhat similar interpretation might be made about the use of . contingency 
management techniques. As indicated in Appendix D, all but two teachers acknowledged 
that their use of -positive reinforcement practices had increased over tf^e past y^ar. By 
definition,* ^then, the Elmount of student-teacher interaction also increased. Thus, from the 
student's point of view, teachers were effective because they employed practices con- 
ducive to learning. A large number of teachers indicated that they used formal con- 
tingency^" management programs in their classes, and observations of teachers in the 
classroom clearly substantiated the widespread use of 'fgeneraj reinforcement." strategies. 
The program teachers became more interested in modifying the frequency of occurrence 
of specific disciplinary and motivational behaviors of individual students instead of simply 
categorizing them^"5s "motivated,^' or "mtmotivated," or "unruly." Chailging student 
behavior became more important than simply accounting foj it. And they now possessed 
the conceptual tools for effecting |uch change. . ;- 



The mstrucric5TTai- processes /used, in the . classroom by the program teacherg clearly 
becaftie more behavioral* (and, hkce, more specific) and more individualized.with regard 
to -student achievement and t/o student motivation and ^discipline. The interactions ^ 
between students and their teacher became determined by the students' ^behaviot more 
than by the. superficialities of instruction: That is, covering content- and categorizmg 

problem children. / . . 

The assignment of tescl/er aides to program teachers cannot be dismissed lightly. 
The fact that more -prograni teachers recommended the continuation of teacher aides 
(item 13, Appendix D) than/any other aspect of the program testifies to^ inSportance ^ 
of the aides. Observations the classrooms by the program ' coordmator aj^id reseai-ch 
staff confirm the criticality/of the aide to the operation of . many formal CM piograms. It 
is doubtful whether any but the most simple token economies could be. operated without . 
the help of an aide.. In i^any instances, the aide relieved the teacher for instistictional 
activities by preparing materials, keepirig records,, supervising practice and study, and » 
managing 'the comings ^d goings of students. The use of teacher aides physically 
facilitated the program teachers' shift toward instructional processes that are indiyidu-, 
alized, and behaviorjally determined. " ' ' .. . - . 

The responses to item 13 in Appendix' D indicated that the three aspects of the - 
program valued by the- most teachers were all tangibles: teacher aides, funds for rein- 
forcers, ^d -help in individualizing instruction.'. The last of these three entries refers to 
help in obtaining and learning, to use commercially prepared individualized instructional 
materials rather than help in developing their own methods and materials. It became • 
apparent durit^g the cburse of the program that teachers siniply do not have the time or 
broad capability t6 undertake the .development of ciofHplete sets of mdividualized 
materials. Howgver, they can modify and supplement commercial materials to fit local 

conditions and needs! " •» • .• . • on* rriu • ^v. 

The fourth most valued aspect of the program was guidance in using- CM. Ihis is tne 
highest valued non-tangible aspect of the program. Because of its high value ^an!ong the .• 
pjGgram teachers, .the -River Rouge School. District would be advised to consider main- ■ 
taining and extending this function as a permanent te'acher resource.- • 

The remaining' entries in item 13 do not clearly differentiate between motivational ; 
and guidance resources provided to the teachers. Although only a moderate number of 
teacher."; recommended their continuation^.in aggregate they suggest some modest require- 
ment for giroup inv^vement and recognition. . " 

While one cannot separate the effects of the follow-on iprogram from the other 
factors'^t seems reasonable to ascribe a large portion of the findings to this aspect. The 
work.shops were instrumental in giving teachers basic knowledge and practice m using 
objectives and contingency management techniques, but it is debatable how well teESchers. 
would have been able to implement the practices in.their classrooms without the special 
assistance and guidance provided by the program coordinator and HumRRO researchers. 
The readiness with which most teachers joined in group discussions of problems, their 
eagerness -to get ideas for problems confronting them, and the frequency with which they 
sought external help in the management of their. classes support the contention that the " 
follow-on program' provided the kind of help they needed. ■ 

One ^n'ight reasonably have expected that the target students would have benefited • 
more from the program because of the performance contracting feature of the funding 
arr'ange^nent that existed"^ during most of the evaluation year. This arrangement provided 
incentive for gains made only by target students. Hence, it is natural to expect that 

• Funds Hot reinforeer.s were made available directly to teachers. This may account for the lack of 
interest in such funds by principals (Item VI, Administrator Questionnaire). 



17 



25 



teachers would make' .special, efforts to- help such* studerfts. While the results make clear 
that teachers did help, targe^'students., there is also evidence that equal help was-|xroyided- 
to non-target students. "Since this incentive failed to" have a differential effect, it is 
questionable whether it operated; as, an incentive at all.* A performance can tract also 
e\istetl bet\yeen the teacher iiM tlie program coordinator, which specifie^Uie responsi- 
bilities of each. A.cOpy of this contract is given' in Appendix F; It seem? mof^f likely that 
this contract established the effective incentives. "'^ \ - ^ 

^ Compared to other teachers, the program .teachers' as a group were probably more 
attentive' to ^ the g<:hievement deficiencies cOt each child, mor^ certain^^s to how to 
.proceejd-^ with each child, less ayersive and punitive and morfe approving of each child's 
learning 'activitie||s, an'cl less likely to abrogate responsibility for solving a child's learfiing 
or motivational problems in the face of initial^ failure. They- had advisory resources 
•available to and used by them in the form of the program coordinator, fellow teachers, 
and" outside consultants. Professional communication arriong the program teachers was 
tMihanced by the program coord in'at'or, by frequent group meetings, by an in-group 
newspaper, ^ind by the common set of concepts and words leamed^to describe classroom 
procoss.es. The net effect of these practices was to replace^the traditional solitary teacher, 
who disptMises information, uncertain pf his motivational and disci plin^ y practices, alone 
and 'unnoticed in his classroom (5), with a teacher who effi^tS. significant 'behavioral 
changes in each child, effectively analyzes anc^ deals withrbehavioral situatiohsf* and 
functions harmoniously as a member of a group .with sharedl responsibilities .for student 
learning and conduct. ^ \ 



! If the eontrzict arrangement failed uo operate as an incentive with regard to student gains, then it 
becomes a matter of interest to determine whether such an arrangement has any effect at all. The River 
Rouge program was already underway when this contract arrangement was^instituted, hence the arrange- 
m(*nt could not have affected program pr'lanriing. But in instances in which iWans-'have not yet been formu- 
lated, ^it' seems rea.sonable to speculate that such an arrangement may encourage the development^pf low- 
ri.sk plans; that is, a school district may choose to remain with a program that they know will provide 
adequate funding rather than experiment with other program.^ that may fail. The- performance contract 
arrangement* in funding may discQurage innovative educational programs. 
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Appendix A > ' ' . 

TEACHER PEgFORMANCE OBJECTIVES 

The following teacher performance objectives were prepared to assist teachers and 
thi' program coordinator of the River Rouge School District in tlie implementation of 
the. "HumRRO Projert," The objectives were prepared to provide a comprehensive \ 
description of desired teacher performance. The prime purpose of the objectives is to 
furmsh guidance to teachers with respect to the accomplishment of their jobs. The second 
purpo.se to aid the program coordinator in his efforts to monitor and give assistance 
to teacher.s. - 

The objei-tives should be viewed as tentative. As teachers attempt to follow them 
md the protT:am coordinator attempts to use them tn his monitoring efforts, cert.am 
omissions (^r other inadequcies may be revealed. Thus, the objectives given here should 
be view.ed as subject to change, hi fact, users of the objectives are encouraged to. submit 
their commeuts and evaluations. 

I'he objectives depict four main types of teacher functions. These functions are: 

[. Develop and implement training practices which maximize student 
al■llUl^iition of knowledge for which the teacher is responsible. 

II- Design and implement practices that strengthen those student behaviors 
that facilitate learning and weaken those student behaviors that interfere with learning. 

Ill, Plan for and implement a program of i')rofessional growth for self 
.and other teachers. , 

' IV. Examine and plan for a test of innovative practices in the classroom. 
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Di^volop and implement trilining' practices whiJh maximize student acquisition of 
performance capabilities for which the teacher is responsible. 

A. Ulentify terminal instructional objectives in behavioral terms-. If is certainly 
possible and perhapsjdesirable that^riot all teachers do all the things necessary 
to identify the terminal instructional objectives, but rather that the teachers 
who teach a given si\l-)ject matter at a given grade level divide 'the work among 
themselves. When this occurs, the program coordinator should insure that the 
group operates effectively and that assignments are accepted and^Understood. 

'1. The teachers should prepare a list of tentative terminal objectives from 
each of the following requirements:. 

" a. The educational performances that will be required of the students 

in 'the next grade of school as determined from the following sources: 

(1 ) The textbooks and classroom tests for the next grade. 

(2) -' Discussions with teachers of Jthe njext grade. ^ - 

(3) Standardized achievement tests administered to students during 
the next year, if any. ^• 

•b. The capabilities expected of students during the present grade of 
school as determined for the following sources: 

(1) The textT?)ooks for this subject matter and grade. 

' (2) Di;5Cussions with other .teacjiers of the same subject niatter 

and grade. • 

^ (3) Expectations of the school administration and community as . 
indicated by school policies. . • 

2. The teachers should prepare a list of final terminal pbjectives that are 
coordinated with the terminal pbjectives for th^cappropriate subject 
' matters in both the preceding and subsequent grades. Particular emphasis 
. should be placed upon attaining resolution of differences among the 
i teachers at the three grade levels. 

B. Identify enabling objectives for each terminal objective to the level of the 
miijiimally prepared student. The first step in thfe identification ot.enabling 
objectives is the preparation of a set of directions that are effective in 
eliciting performance of a behavioral act from minimally, prepared students. 

1.1 The teachers should prepare a dra£t*set of directions for performing the 
1 behavioral acts specified by each objective at a level of detail and language 
believed to be appropriate for minimally prepared students. Initial effort 
sliould be placed on those objectives whose attainment has generally been 
1 most difficult. ' 

2. The teachers should test the accuracy 6f the draft sets of directions by 
i submitting them to each other for a performance review. 

3. . I The teachers should test each set of directions with one minimally. pre- 
I pared student at a time and revise the directions on the basis of the 
: outcome of the test until the directions are effect;ive in eliciting proper 
performance from such students. 



^i. Formulate si^mificant directions in each set as enabling objectives, paying 
particular attention to organized information to be stored in memory and 
perceptual-motor skills not passessed by minimally prepared students. 

Arrange both terminal and enabling instructional objoctiv^s mtb appropriate 
groups and orders. , . , • . 

1. Arrange the terminal objectives into primary groups in terms of common 
. enabling objectives; i.e., in terms of common information pools, common 
" perceptual-motor skills, and similar sets of .directions. This may be done 
most readily by arranging terminal objectives along one edge of a matrix, 
enabling objectives along the other edge, and placing ''X"s in the appro- 
priate squares. Primary groups of terminal objectives are those which 
share few, if any, enabling objectives with ot\ier groups. Further analysis 
of primary groups can btf performed by different teachers so as to reduce 
the amount of work required from any one' teacher. 

--2-.- — Arrange fe^-terminahobjwrivesTH BaclrpretiTrm"iary gnrup-in ordeT'of ' • 
learning difficulty. ' 

. a. Make estimates about the learning difficulty of each enabling objec- 
tive in the primary group: Easy, moderate, and difficult should be 
sufficient. • - 

h. Select as the first teiUiinal objective to be attained that on^ which 
subsumes the fewest, easiest, and most common enabling objectives 
and. proceed in this manner until all enabling objectives have been 
placed in an order. It is- not necessary to place each terminal objec- 
tive into a precise point in the order, but only into order categories. 

Implement effeciive learning activities for each otyjective in each primaf^^ group. 

1, Identify each objective as being principally concerned with one of the . 
> following learning functions. 

a. • Information retrieval, 

h. Perceptual-motor skill. ' ^ 

V. Complex performance. ' ' ; ^ 

2- Develop an instructional strategy for each objective. The overall goal is 
to maximize the number of effective learning responses emitted by each ' 
student during each class period. General requirements for strategies for 
each kind of learning function are as follows: 

a. Strategies for information retrieval objectives should allow the 
student to practice in randomly presented information retrieval 
events with immediate feedback. Tlashcards are an example. The 
student may also be provided with memory aids to prompt retrieval 
in' some or all events. Preferably, memory aids should be on a demand 
schedule such that they are presented only at the student's request.; 
This may require that students work in coach-pupil pairs in lieu of. 

, using special machines or devices. 

b. Strategies for perceptual-motor skill objectives will vary depending- . 
upon the particular kind of skill involved. Regardless of the details of 
any particular strategy, all of them should provide each student with 

IP/ 
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inany c)p{k)rtunities m which to practice the skill under conditions 
of prompting on demand and immediate feedback. Again, it may be 
most economical and effective to arrange students in coach-pupil p^rs 
working with specially desi^?ned materials. 0 

c. "Strategies for complex performance objectives should provide the 
student with prompting on demand for each step or group of steps in 
the procedure. Directions for all except very short procedures should . 
^ include a multi-level outline as a memory aid. In many instances, early 
learning can be concerned solely vidth acquisition of the verbal directions 
without actual practice of the performance. In this manner the student' 
. , can prbvide his own directions during later learning. 

Implement apprc^)riate learning management procedures. The overall goal is to 
maximize^the number of effective learning responses emitted hy each student 
during each class period. The amount of time students spend attending to presen- 
tatiomLylj -dx?ing 4bi«^s^l^i€h-they- 

already do adequately well, or doing things which are well beyond their immediate 
i:ai>ability should be reduced to a minimum. Again, different parts-of the develop- 
mental work can be performed by different teachers so as to reduqe the amount 
i)f work required. from any one teacher. "- .v : 

1. The teachers should develop an evaluation system which assesses each 
student's entering capabijities' and governs his progress 'through the instruc- 
tional program. " . 

a. Prepare a number of test items for e^ch objective, as appropriate. 

h. Assemble the items into at least two alternate test forms for each ' > 
objective or group of objectives to be used for both placement and 
mastery progression evaluation. 

c'» Assemble the remaining items into self-administered tests to be used 
hy students in the instructional program to determine their own readi- 
ness for the next progression test. " 

2. The teachers should develop a record-keeping system which displays the" 
following information about each student. 

a. His point of entry into each continuum of objectives as determined by 
placement tests. 

h. His attainment of objectives as' determined by mastery progression tests.. 
,c. His present placement on each continuum of objectives. ^ 
d. - The objectives which he has not yet attained. 

3. The teachers should develop or select instructional materials. which, in so far 
as possible^ are capable of being: 

a. Machine-administered, a 

h. Peer-administered, or 

c. Self-administered. 

t» . • _ 

t. Each teacher should detect and correct progression difficulties in instructional 
materials. > . . 
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a. Proj^mssidn difficulties are indicated when: • 

(1) A large number of students fail a progression mastery test on the ' 
first time through the instructional materials for that test. 

(2) Some students, who'fail on the first try, recycle again and again 
without significant improvement. . ^ 

b. Diagnosis of the difficulty should be based on observation and on 
tutorial trials by the teacher with students who failed to leara. 

c. Draft revisions should also be tested by means of tutorial trials with 
' .students who'f ailed to learn with the original materials. Revisions 

should continue until satisfactory test results are obtained, ; 

II. Design and imple^fient practices which strengthen those student behaviors that facilitate 
learniiig aml_\veak||n those students behaviors th^t interfere with learning. 

A. Implement a classroom environment that minimizes the occurrence of aversive 
stimulation. - ^ 

.1.' Oiven a classroom situation typical of the teacher's experience, the teacher ^ 
should list the possible aversive conditions that could exist in the classroom, 
Aversive conditions may result from teacher behaVior, student behavior, or 
from some .situation within the school system. The teacher may a^k the 
students in her class to prepare a list of conditions that they think are aversive. 

2, Given a list of aversive conditions that may exist in a classroom, the teacher 
should identify those that actually exist in her classroom. The teacher may 
seek the assistance of the program coordinator, the students, other teachers, 
etc. in identifying the'conditions. • 

'3. Given a list of aversive conditions that actually exist in her classroom, 'the 
teacher should, with the aid of students, prepare a set of classroom rules that 
wiiraid in minimizing. aversive conditions. The teacher may also seek the 
assistance of the progi-am coordinator in'preparing classroom rules. The 
teacher should plan her in^struction around aversive conditions that cannot 
be eliminated. In effect, the teacher would; be Tninimizing the influence of 
such aversive conditions. , • 

; B. Implement a reinforcing environment in the classroom thaVwill strengthen '(or 
elicit) appropriate student learning behaviors. 

™ 1. Given the schedule of the'^academic program for the school year, the teacher 
will prepare a list of student activities, defined in behavioral terms, in each^ 
. category of behavior that facilitates learning. Suggested general categories 
c of behavior that facilitate learning a^e: ' 

a. Orientation, which involves getting students in contact with instruc- 
tional materials and keeping them in contact for sufficient periods of 
time. The term instructional materials includes verbal as well as 
printed materials; . .. 

b. Attending, which refers to students' presence in the classroom or 
attendance at special school activities; 

c. Le.sson completion, which refers to the completion of assigned school 
work, either in the classroom or away from the classroom; 
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d Non-mterferenc-e behavior, which includes behavior that does not 
interfere withianother student's learning activities. This may include' 
tht^ absence o|: certain behav " -'•s such as fighting or othe'r aggressive, 
behaviors. r . 
} Given the list of student behaviors that facilitate leaning, ,ne teacher will 
' rtnpTement the general cohtingency Hanagement procedures to ehcit and . 
maintain such behaviors. In using; the general CM procedures, the teacher 
will use sociar reinforcement (approval, praise, success in learning) and will 
ignore inappropriate behaviors that are not harmful to the student exhibiting 
the behavior or to others. When reinforcing students, the teacher should 
minimize inadvertent reinforcement of inappropriate behavior. 

Desigrt and implement a mQnitoriug system -to be used in identifying students that 
do iiot respond to the general CM procedures with appropriate learning behaviors. 
1 Given a classroom environment that reinforces appropriate learning behaviors, 
the teacher should maintain a general observation of student behavior for the - 
purpose of identifying inappropriate individual or group behaviors that persist. 

•> Given an indication of the need of a formal CM program, the teacher will 
develop techniques for formal observation of individual or group behaviors. 
\ behavioral statement of the inappropriate behavior should be prepared by 
-the teacher. An observation schedule should be prepared providing for 
specific periods of observing and recording the occurrence of the inappro- . 
priate behaviors. Record forms must be modified or developed for data^ 
recording during the observation periods. 

"3 Given the schedi'iTe for observing a specific inappropriate behavior and a set 
orrecord forms, the teacher (or teacher aide) will observe and record the 
occurrence of the inappropriate behavior for five to ten days. At the end 
of the observation schedule, the/teacher will summarize the recorded data 
and determine if the inappropriate behavior occurs often enough to present 
a real problem (interferes with the learning process). 

4 Given data to indicate that a specific inappropriate behavior presents a 

problem, the teacher will conduct a behavior analysis to identify the aspect 
of the environment that is maintaining the inappropriate behavior. Ihis task 
J . will result in' the decision, that there is or is n-ot a need for a lormal CM 

program for changing the behavior. - V 
De'velbp and implement a formal CM program for strengthening appropriate 
learning behaviors and extinguishing inappropriate learning behaviors. 
1 Given a behavioral statement of an inappropriate behavior to be eliminated, 
an appropriate behavior to be elicited and strengthened, and the environ- 
mental element that is maintaining the inappropriate behavior, the teacher^ 
will prepare a statement bf a strategy to be used for modifying the behavior. 
The complete statement of the_ strategy will include: 

a. A list of.reinforcer's developed in consultation with the student(s), 
principal, project coordinator, and parents,.if necessary. 

b. A set of instructions to be given to the student(s) and class 8s an 
explanation of the CM program. . ■. 

c Example.s of the forms to be used in-recording the observation data, 
along with graphs to be used in analyzing the progress of the program. 



d; A schedule for obsemtion of behavior and administration of 
reinforcers. i 

2. Given the complete statement of a CM program for modifying a specific 
classroom behavior; the teacher will implement the program in the class- . 
room. Implementation of the prograni requjres the following steps to be 
accomplished by the teacher: ^ - 

•a. All of the materials specified in the progi-am statement will be assembled 
prior to beginning the program. • ^ 

b. If 'baseline data has not been obtained, the teacher (or teacher aide) wiH • 
observe and record the specific inappropriate behavior for five to 

ten days. ' . 

c. The programs should be started on a Monday by reading the set of ■ 
. . instructions to the student(s) and class. 

■t . 

■ d. Following the schedule for observing behavior and administering rein- 
forcement for the appropriate behavior, the teacher should record and 
graph-the behavioral data daily. At the end of a two-week period, the 
U^acher should analyze the charted data and determine whether the 
J program shouW be continued ..s is, .modified, or ended. 

e. When the program is concluded, a brief report should be prepared 
according to the following format: ^ ■ 

(1) Description of inappropriate and desired behaviors, and what was 
maintaining the inappropriate behaviors. 

(2) A brief tstatement of the^^strategy used. 

* (3 ) A list of reinforcers anld description of how they were admioistered. 

(4) A graph of the behavioral data recorded. 

(5) Any comments you feel like making. • 

f. . Following th^ completion of the formal CM'program, general CM 

procedures should be used periodically to maintain the appropriate 
behavior. . 

In the final two f^mctions, the meaning of certain actlun verbs or other concepts may 
t be completely explicit. Therefore /the following definitions or alternate^ terms are provided 

Concept ' ' Alternate Term ' \ 

■ profession'al growth development, advancement, improvement, 

betterment; an increase in capability as 
' - a teacher 

innovative educational practice novel, new, promising educational practice 

Primary Action Verb Alternate. Verb or Phrase < 

facilitate assist, aid, help, promote 

review examine, study, comment upon 

determine judge, decide 

•read ' study, review . . 



Primary Ac tion Verb - 
attend 
select 

seek . . 

try out 
reinforce 



Alte rnate Verb or Phrase . 

' be present at 

choose, pick out 

solicit, request, ask for , • 

test, make a trial use of 

strengthen., ''reward,"^acknowledge the 
worth, of . , 



III. Plan for and implement. a program of prof essional growth for selSand other teachers. 
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Identify areafe for personal improvement . 

1 . At staff meetings, informal staff gatherings, and on other occasions when- 
teachers might congregate, the teacher should facilitate discussions related 
to professional growth. As an example, the teacher should be prepared to 
recommend possible activities that might lead to professiotial growth, as 
well as to react constructively to ideas about growth as proposed by other 
•teachers. The teacher should not make unfair or unwarranted criticisms of 
the suggestions of other teachers, but should seek to provide positive, ^ 
solution-oriented Comments. Also, the teacher should encourage and rein- 
force attempts by other teachers to provide comments. 

- 2. ^ From discussions with the program coordinator and with his assistance, 
' the teacher should determine areas where his teaching performance is weak 
and where personal improvement might be desirable. Considering the fact 
that few people/are perfect, the teacher should be able to list two or three 
areas at any time. ■ * ^ . 

B. Determine possible courses of action to bring about improvement in professional 
capabilities. • . " 

1. Given access to selected journals and/br m^^azines whose intended a 

is the professional teacher, the teacher should^outinely read (or scan) such 
publications for the purpose of acquiring information and suggested actions 
one mighf take with respect to improving ^his professional* capabilities. The 
teacher should be prepared to report to fellow teachers some Of the, actions 
described or recogamended in the publications. . 

2. When feasible in terms of leaching load, location, and cost, the teacher 
should attend conferences, symposia, and workshops that are focused on 
professional problems of interesj: to the teacher. The teacher should be 
prepared to report to fellow teachers any problems and recommendations 
that might emanate from such conferences'. * . 

C. Encourage personal improvement efforts by cither teachers. 

1. In all types of situations where teachers may engage in discussions .focused 
on professional growth, the teacher should consistently reinforce the 
efforts of -other teachers to suggest ppsitiye ways to- improve their teaching. 
As convenient and appropriate, the- teacher, should publicly acknowledge 
the merit of suggestions of other teachers or otherwise make kno^n his 
support of the suggestion. 
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2. When invited' by a fellow teacher (or program coordinator) to revieA^ the 
products (lesson plans, objectives,. test items, etc.) and classroom activities 
(teaching practices, learning activities, etc.) of a fellow teacher, the teacher 
sltould reinforce t^e efforts gf the fellow teacher to producg quality instruc- 
tional materials and to employ effective practices'in. teaching. As con>ienient 
and appropriate, the teacher should publicly acknowledge the merit of ttie 
other teacher's products and practices. This may be done in the presence of - 
the fellow teacher, other teachers, principals, program coordinator, etc. 

IV. Examine and plan for'a test of innovative practices in the classroom. ^ 
A. -Identify and select feasible innovative training. practices. ' . ; 

■ 1. When feasible in terms of teaching load, location, and cost, the teacher should 
attend conferences,, symposia, and workshops that are devoted to discussion ^ 
and/or evaluation of innovative training practices. The teacher should be 
prepai^ed to report to fellow teachers regarding the status of such practices 
and should be able to defend any recommendation he might make that such 
■ practices should be instituLed ifi his. school district. , 

2. ' The teacher should routinely read (or scan) reports, articles, and books that 
describe and tout innovative training practices. The teacher should be prepared 
to report to fellow teachers regarding his understanding of the status of such 
practices and should be able to defend any recornmendation he might make 
, that such practices should be instituted in his school district. 
JB. vVrrarige for test and evaluation of selected innovative practices. 

1. After attending conferences oi; after reading literature touting given innovative 
. ' practices, the teacher should be able to select a new educational practice for 
trial implementation in his classroom. The teacher should' be p^pared to 
defend his selection of an innovative practice to implement. 

> 2. After having selected a given innovative practice to implement in; his class- 
room, the teacher should seek support and approval of his principal and 
- other'administrative officials for trial us6 of the educational practice. To 
improve his chances of obtaining approval, the teacher should carefullj^ 
document the evidenqe in favor of the new educational practice and be pre- 
pared to deffend his selection of it. » 

After receiving approval and support from his prindpat and/Other adminis-^ 
trative officials, the teacher should be able to try out a new educational 
practice. The teacher should use controls as appropriate and provide for a 
. i valid evaluation of the effects of the practice. / ' . . " 
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Appendix B 



. PROGRAM COOR4DINATOR PERFORMANCE OBJECTIVES 

militate improvemeats in the learning environment in each teacher's classroom, 
■ Diagnose the learning environment in each classroom with regard to: 

1. Aversive stimuli. Monitor for aversive practices by thfe teacher and aide, . 
aversive social behaviors among students,- and aversive physical conditions. 

2. Specified achievement. Monitor fon^the existence and use of both terminal 
and enabling instructional objectives with mastery learning requirements. 

' > . '» ■ * 

3. ResponsGrrich learning activities with contingent positive reinforcement. : 

4. Learning facilitation behaviors. - . 

5. Disruptive behaviors. - i * ' 

• List all possible courses of action for correcting each deficiency ancj negotiate 
an appropriate change program for each diagnosed deficie/icy. Such pro|jams . 
may" call for; ■ ' ■ ^ ' ' ■ ^ 

1. .Behayior changes in teacher and aide behavior, in. student social- behaviors, 

. and in student learning of^ilitation behaviors. • * - \a 

2. Development or acquisition of instructional objectives or instructional 

• materials. These programs may call either for selecting ^nd ^Duying-com- 
mercial materials or developing teacher-made" materials. Cooperative activity 
^ may be required among teachers either in selecting commercial objectives. ;^ 
and materials or in dividing -the Work refquired to develop teacher-made 
objectives or materials. 
Follow-up each change prbgram.-^- - ' • -^^-^^ 

. L Insure that appropriate support is coordinator for each program. Such 

support may include f eleased time for. group meetings , secretariM support, 
books, journals, tangible reinforcers, changes iti policies, etc. I 

2. Monitor the implementation of each program. * ' . ^ 

a. Behavior change programs.. Periodically visit each classroom and 

' . observe behavior and learning environment. In addition, pe.riodically 
meet with each teacher to discuss progress of each program. 

b. Cooperative programs ^o¥ig teachei;^. Insures that eachj:eacher^under 
stands his part of the-eff ort. Periodically meet with te^chei:s to review 
prqgress. - . • • 

■^c. Acquisition of commercial materials. Insure that orders are placed and 
insure thaTmaterials^l^e speedily distributed when they arrive. Visit 
class-Yooms to insure that materials are properly^used. 

3. * Negotiate modifications in change programs, if necessary. 



J 1. SuliriL a fornuU ropc^rt at the eomplotion of each behavior change program 
^ ' from each teacher. * 



4u-ilitate professional growth in each teacher and innovative practices in each 

cjassroom. . ^ " , , 

i "^"Urrarigt^' fox and encourage teachers to meet together to disciiss the development 

of program^ for their own professional development and innbvative classroom • 
' practices. Reinforce teachers for change activities and re^ai^ from non^constructive 
criticism. I • 



i. .Vrrange to provide teachers with access to books, journ^ jind magaz-ies ^hose 
mlended audience is the profess onal teacher 'and encourage them to attend 
conferences, symposia, and workshops that ai'e focused ^nlprofessional 
• problems of interest to the teacher and on classroom inn6jations. . 

v. ('(oordinate support requirements for' each teacher's professional growth and 
. ^ . classroom innovation activity. / ; 

I). ' RtMnforce professional developmertt acti^^ities'and classroom innovations under^ 
taken by each teacher. At the very least, visit the, classroom to observe the: 
mnovation as soon as the teacher indi^^ates that he is ready for such a visit. 

: ' Abo^ provide social reinforcement. V. . ^ . 

E. Ent'ourage and'tu-range for teachers to report on' their inno\^tive activities .o ^ 
other teachers in the district. s 



Appendix C , 

• ■ . ■ ^ . • 

INFERRED WCHIEVEMENT TEST OBJECTIVE^ 
c. ' WITH SAMPLE TEST ITEMS 

Given a word of one or two syllables pronounced orally by the teacher, select trom four 
letters the letter with which the word begins. t 

Test Item: < ' ^ , . 

1. . Teacher says: Dog. Student selects 'initial letter from^thesG four letters: • 
' ' p, h, t, d. ' . ^ 

2. Teaeher says: ^Vfter. Student selects initial letter from;. these four letters: 

Given a word of one or two syllables pronounced orally by the teacher, select from four 
letters the letter* with which the word ends. f 

Test-Item: ' » * 

• • . ■ . . / 

1. Teacher says: Nail.' Student selects finalletter from these four letters: 

b, ,1, n, a. ' . *• ■ • - 

' *■ . . ' 

2: "'Teacher says: T^ible. ^Student selects final letter from these four letters: 
. t;m;q, e. . ^ . ' , 

Given . a single printed key letter, select froiTi four alternatives the one letter- that is the 
same as the key letter. Key letters and letters in the alternatives may be small or capital, 
and thev may be unlike in size, e.g., key letter small, alternative letters capitals. 

Te>st Item: • ^ " ^ , . * . >j 

- 1. G . ,L V G E * 

2. ,K , qkql ? ■ ' - ; ^ ' • 
5. p '2prv ' , ' • ^ 

• Given a word pronounced orally by the teacher, select from foiir printed \yords the word 

that the teacher pronounced. The words should contain from three to seven letters and 
.,^.<hoUld have one or two syllables. , , . 

Test Item: . / - . * 

1. grab grip girab grov?r grain ' . 

o*'2. won win war will won ^ . ' ^ ' . 



Given a passage having the following eharac terist ies : ' 

a. . Appfoximately 30 to '85 \v>)rds, 

b. / One paragraphs 

'V-. An average of 10 to 12 words pt*r sentence, . 

a. Ah average of 1.1 to 1,3 syllabh^s per word, and 

k\ DeaUng W.ith animals, boat rides, airplanes, or buildings, 

the studfc nt will respond to as many of tl^e following kinds of items as are appropriate: 

■ „ p ■ • 

Test IteiDrfj . • * 

Mary had a'fuzzy little eat. wShe.played with it each day after school^ometimes 
shM U)ok it to the park and let it climb the walnut tree. She and the <fet were 
very happy. (35 words) 

1. Mary*s cat was ^ • ' ' ' 

big , . ' • ^ 

fuzzy ^ 

yellow . • • 

^. ♦ sick ^ : • ' 



2. Mary toc^k her cat' to the 

stor^ 
street 
housj* 
park 

3. Where was th » walnut tree? 

m the backyard, 
at the school 
in the park 
in the forest 

4. Mary played with her cat 

- sometimes 
weekends 
daily 
mornings 



/ 



r 



5. Whicl? of these is the best title for the story? 

Books 
. (;ats ^ ^ 

Cnrs 
lovs 
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lo;iOht»r-Made Instructional Objoctives and Test Items 



(liven a riddle, the pupil must be able to correctly supply a rhyming word as the answer, 

Testjte.m: 

"Flower, flower, 
Pretty as can be, « 

Flower, flower, , ' 

Cirbw for 



Given a selection of spoken words, the child will identify the short vowel sound. 
Test Item: 

Tell me the short vovC^el sound in these words: hill, sun, top, pet, hat. 



(}ivt n a group of (»ompound words, the student must correctly divide each word into its 
two words. 

Test Item: ■ 

Draw a vertical line between the two words. ^ , . 



necktie 

fingernail 

fireman 

fishhook 

hotdog 

treetop 

raincoat 



Given a ^^roup of words, the pupil must correctly use the following verb endings: 
*'s", *'ed'\ and ''ing*\ 

Test Item': ' ' 



Fill m the correct ending (s, ed, ingi) for the action words in these sentences: 



e,g, Tom jump over the box laki night. 

The dog IS bark , i 



/ Appendix D 

TEACHER QUESTIONNAIRE 

Junes, 1972 

Name 

I School — - 

' ' y • ^"Tirade . 

Ii\ an attempt to evaluate the HumRRO Project, your best judgment is requested in answering 
the following (iut»stions. (^heck the blank that is appropriate. ANSWER ALL QUESTIONS. 
Rrtiirn to Frrd Rickm by June 13, 1972. Please use. the enclosed envelope. 

1 . With respect to the objectives prepared during last mmmer^s workshop, how much have you 

a. Used them in preparing your lesson plans? 

13 quite a lot • . 

8 a fair amount 
...J?_ some 

3 hardly at all ' ^ ' ^ 

7.... not at all 
_1_ no response ; 

b. Used them to check-off pupil progress? 

11 cjuite a lot 

. 11 a fair amount - 
I] some 
1 hardly at all 

8_ not at all ' , • „ 

1 _ no response \ 

\ 

2. With respei^t to the textbook objectives {math modules, other books), how much have your 

a. Used them in preparing your lesson plans? 

■ 10 (luite a lot 
13 a fair amount ' . 
5 some 
2_ hardly at alt 

_J2_ not at all * 
I sed them to checkoff pupil progress? 

12 (iuite a lot 

13 a fair limount 

4 some 

1 hardly at all . * 

5 not at all . ' 
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3. In addition to the above, how often have you prepared your own set of objectives? 

14 quite a lot 
4 a fair amount 



15 some 

hardly at all 
1 not at all 



4.- If you prepared your own objectives, how much have you: 

a. r>sed them in preparing your lesson plans? 

' 20 quite a lot 
4 a fair amount 



9 some 

0 hardly at all 



1 not at all 
1 no response 



b. Tsed them to check-off pupil progress? 

18 quite a lot 
B a fair amount 



10 some 

0 hardly at all 

0_ not at all 

]^ no response 



In what content areas have you used the^ objectives listed below? ^ 

Workshop Textbook My Own 

Ccmtent Area Objectives Objectives Objectives 

24^ 22 26 



Rt»ading 

Arithmetic . , 22 20 - — 18, 



Science 



13 13 



Health ^ ' 2^ 9_ 13. 

Social Studies 5 12 12_ 



19 22 
18 26 

^J^4 18 



Spelling 4 ^ 

Uuiguage Arts — _2 

I Umd writing * 1 ^ 

PLEASE NOTE: You may need to check more than one kind of. objective for a given 
content area. ' 

6. Have you attempted to individualize instruction? 34 1 

YES NO 
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7. If YES to Item 6, did yi)u use: 

a. Commercially prepared materials? ^ / — ^ 

. • ' YES NO 



b. Your own materials? 



28 7 



YES NO 

S. If YES to item 6, in what content area(s) did you attempt to individualize mstruetion: 



Reudmg 
. Arithmetic 
Science 
Health 

Social Studies 
Spelhng 
Umguage Arts 
. Handwriting? 



Y|ES 


NO_ 


. .k... 


1„ 




11 


I 4 


29 


3 


30 


; 5 


■ 28 ■ 


/ 19 






•19 : 


/ 12 


20 



9: hi your opmion, how successful we^-e you in individualizing instruction: 



10 quite successful 

16 fairly successful 

7 slightly successful 

1 had problems 



Q it didn't work at all 

1 0. Have you applied, any formal C^I^l Progi'ams in the classroom? 

■/ ■ . • . ■ ' ■ 
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YES NO / 

11 . ,n your opinion, did your ust'^ of positive reinforcement practices over the past year show: 

12 a big incrc/ase 
16 a moderate increase 
5 _ a slight ixHTease 

1 no increase at all * • ^ 

1 a slight decrease * ' ' « 

12. What do you find to be the most effective disciplinary practice(s) in managing your students? 
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13. • What aspect of the projt^ct do you recommend being continued next year: 

29 Help in individualizing instruction ^ / 

Help in using objectives in teaching 
24 • Help' in using (Contingency: Management (CM) in the classroom 
12_ Classroom abservation by PX\ 
13 Lunch time study sessions 
16 The Bugle 

11 Technical assistan(^e by HumRRO personnel 
34 Teacher aides assigned to project teachers 
29 Funds for reinforcers 



{Add your own) 

{Add your own) 



14. If you had the powe^r and authority, what one thing would you change" in the project to 
make it mort* t^ffeu'tiveV 



If), Ust ALL gripes and praises! {may use back of this sheet) 
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Appendix E 
ADMINISTRATOR EVALUATION 



June 6, 1972 



In an attempt. to evaluate the HumRRO Project, your best judgment is requested in answering 
the following questions. Check th^ blank(s) that is appropriate. Be sure to answer ALL 
questions. Return to Fred Rivkin by June 13, 1972. , 

I. How many Contingency Management (CM) Programs, both academic and social, have 
been carried out by your staff? 

■ « ^ 

" 1 a large number , - 

1 quite a few 

2 a few 

() one or two 

Q .none to my knowledge 

IL Changes in your staff's performance {competence in using CM and objectives) have" been: 

1 quite substantial 
2 substantial 

1 moderate 

0 very slight 
Q what changes? 

III. How often did individual staff members consult with or inform you of their proposed or 
on-going CM Programs? 

Q ^ quite often • . 

2 often 

2 on occasion 



_0 seldom 

0 never 



IV. What is the attitude of the project teachers tgward the program? 
1 extremely favorable 

3 favorable " 
Q neutral ' - . 
0 unfavorable " 
' extremely unfavorable 
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V. WTiat do you perceive to be the community's attitude toward the program? 
Q extremely favorable , 



_3 favorable 

1 ^ neutral 



_Q unfavorable 

_0 extremely unfavorable 



VI. What aspects of the project do you recommend being continued next year? 

jX Help in individualizing instruction 

4 Help in using objectives in teaching ^ 

2- Help in using CM in the classroom 

2 Qassroom olpservation by Project Coordinator 

2 Lunch time study sessions 

1 The Bugle • , 

% 2 Technical assistance by HumRRO personnel 

2 Teacher aides assignments to project teachers 
jQ Funds for rein forcers 

0 (Ad(d your own) 

0 (Add your own) . 



ERIC : 48 



Appendix F 



AGREEMENT BETWEEN PR'OJECT TEACHERS AND , * 
PROGRAM COORDINATOR 1971-72 

Program Coordinator responsibilities: " - ^ , . 

The PC agrees to the following: i . '\ 

1. Observe teacher behavior in the classrooiji and provide feedback on teacher performance. 
Classroom visits will be made on a regularly scheduled basis throughout the school year. 

2. I^rovide assistance in: ^ . 

a. Planning and carrying out CM programs. . ^ 

b. Over(\)ming technical problems associated with program operation. 

c. Creatmg a positively reinforcing learning environment. 

d. Using individualized instruction. 

3. Prepare and distribute status reports on the project. 

4. Publish and distribute a^ project newsletter on a regular basis. x. 

5. I^rovide administrative support for innovative teaching practices consistent with individuali- 
zation, utilization of objectives and CM. ' 

B. Provide teacher aide assistance to project teachers. This assistance is, of course, dependent 
on the level of federal and state funding. , ' 

7. Provide funds for the purchase of reinforcers* to- be used in CM programs. 

8. Provide fund& for individualized instructional material that is consistent with project 
objectives. ■ % ' 

9. Publicly acknowledge, verbally ?nd in writing, teachers who conduct successful and/or 
innovative teaching practices that are consistent with workshop objectives. . . 

Follow-up program teacher responsibilities:- 

1. Create a positively reioforcing non-aversive learning environment in the classroom. This, 
is determined by. the observation of teaching behaviors. Sorne -of the behaviors to be 
observed include the number of : 

a. Response opportunities. , - * 

b. Approving behaviors. " . ' ^ ^ 

c. Disapproving beha\dors. ^ • ^ r ^ 

2. Use pupil performance objectives in the teaching of reading and arithmetic. Use a check-off 
. system to record pupil achievement of objectives. 

3. Provide opportunities for pupils to learn on an individualized or self-paced basis. 

4. I'se contingency management procedures and techniques in a formal program to change 
' • pupil's behavior (social and academic) as the need arises. Before beginning a CM 

program,*submit a' written description of program procedures to the PC: Supply data ^ 
' on the results of the program, 

5. Attend regularly scheduled follow-up meetings with project staff. 

6. Prepare and submit reports on project progress. - / 



The achievement of these objectives should reslilt in: " ^ 

1. The teacher passing a witten CM examination and becoming certified in contin- 
gency management, ^ 

2. Each pupil m the class improving by 1 grade point equivalent in reading and 
arithmetic . 
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